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GEOMETRIC APPROACH TO SAMPLING AND 
COMMUNICATION 

EMIL SAUCAN*, ELI APPLEBOIM 1 , AND YEHOSHUA Y. ZEE VI 1 " 



Abstract. Relationships that exist between the classical, Shannon- 
■ type, and geometric-based approaches to sampling are investigated. Some 

' aspects of coding and communication through a Gaussian channel are 

considered. In particular, a constructive method to determine the quan- 
tizing dimension in Zador's theorem is provided. A geometric version of 
Shannon's Second Theorem is introduced. Applications to Pulse Code 
Modulation and Vector Quantization of Images are addressed. 



1. General background 

1.1. Introduction. We consider a geometric approach to sampling, based 
on sampling the graph of the signal, considered as a manifold, rather than 
■ sampling in the domain of the signal. Whereas the latter is widely used 

, in both theoretical and applied Signal and Image Processing, motivated by 

the framework of harmonic analysis, it is important to note that Shannon's 
original work is deeply rooted in the geometric approach, at least intuitively 
[44] . [45] . Indeed, this geometric viewpoint of the problem distinguishes 



(N 

' Shannon from Kotelnikov [23] and Nyquist |33] , and allows one to transcend 

the restricted context of technical communication theory. We were also 
inspired in our endeavor by the "dictionary" of geometry-to-communication- 
theory notions, and we strived to emulate it. Other paths towards the 
geometerization of Sampling Theory can also be found, e.g. in |35j and [22j . 

Having adopted a geometric approach to sampling, we are concerned with 
a broad spectrum of signals which can be categorized as geometric signals - 
see Definition 1.3 below. In particular, we are concerned with images that 
are represented as multidimensional signals and embedded, as such, in R , 
for some large enough N. This approach to signals and images has become 
very popular and well established in recent years, hence it calls for revisiting 
the basic issues of proper sampling of manifolds and related problems. 
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Our approach is based on the following sampling existence theorem for 
differentiable manifolds that was recently presented and applied in the con- 
text of Image Processing ( [41] , [42] )Q 

Theorem 1.1 ([42]). Let S n C R N ,n > 2 be a connected, not necessar- 
ily compact, smooth manifold, with finitely many compact boundary compo- 
nents. Then, there exists a sampling scheme of S n , with a proper density 
V = T>(p) = ^(^y) > where k(p) = max{|A;i|, \k n \}, and where k±, k n 
are the principal curvatures ofYT 1 , at the point p £ S n . 

(For moore detailed exposition of the Differential Geometry and Topology 
notions see the Appendix and [9]). Here, by "proper" density, we mean that 
it will satisfy the (analogue of) the Nyquist rate, of the classical sampling 
theory and algorithms. 

It is important to note that Theorem 11.11 does not necessitate having 
exact locations of the sampling points. Thus, the above existence theorem 
lends itself to a stable constructive algorithm for sampling of manifolds and, 
therefore, of sampling of higher dimensional signals. Moreover, the following 
corollary is also applicable to this problem: 

Corollary 1.2 ([42]). LefE n ,V be as in Theorem \l~l[ If there exists ko > 0, 
such that k(p) < ko, for all p 6 S n , then there exists a sampling scheme of 
S n of finite density everywhere. In particular, if S n is compact, then there 
exists a sampling of S n having uniformly bounded density. 

Note, however, that this is not necessarily the optimal scheme (see [42] . 

in)- 

The constructive proof of this theorem (of which we outline in the Appen- 
dix just a sketch) is based on the existence of the so-called fat triangulations 
(see [37]). The density of the vertices of the triangulation (i.e. of the sam- 
pling) is given by the maximal principal curvature. An essential step in the 
construction of the said triangulations consists of isometrically embedding 
of T, n in some M. N , for large enough N (see [34]), where the existence of such 
an embedding is guaranteed by Nash's Theorem (|_32j). Resorting to such a 
powerful tool as Nash's Embedding Theorem appears to be an impediment 
of our method, since the provided embedding dimension N is excessively 
high (even after further refinements due to Gromov [15] and Giinther [16]). 
Furthermore, even finding the precise embedding dimension (lower than the 
canonical N) is very difficult even for simple manifolds. However, as we 
shall indicate in the next section, this high embedding dimension actually 
becomes an advantage, at least from information theoretic viewpoint. 

The resultant sampling scheme is in accord with the classical Shannon 
theorem, at least for the large class of (bandlimited) signals that also satisfy 

similar approach to ours appeared in [27] but, mathematically less rigorous and 
comprehensive. Since we were not aware of this study upon the publication of our previous 
works [41], pQ, we use this opportunity to rectify it. 
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the condition of being C 2 curves. In our proposed geometric approach, the 
radius of curvature substitutes for the condition of the Nyquist rate. To 
be more precise, our approach parallels, in a geometric setting, the local 
bandwidth of |17| and [53]. In other words, manifolds with bounded curvature 
represent a generalization of the locally band limited signals considered in 
those papers. However, the 1-dimensional case is a limiting, degenerated 
case, from the geometric viewpoint. As the notion of fatness (of simplices), 
essential to the geometric sampling scheme (see [42]), reduces, accounts for 
dihedral angles, and since on the real line we cannot impose such angles, 
the 1-dimensional version of Theorem 11.11 practically reduces to uniform 
sampling according to the Nyquist rate. 

It should be stressed that, in comparing the classical and geometric ap- 
proaches, one should bear in mind that no algebraic structure is presumed in 
the geometric context, whereas it is implicitly assumed in the (infinite) sum 
appearing in the classical version. Also, it should be noted that, in fact, 
Shannon already had the intuition of the role of curvature (using second 
partial derivatives) for sampling and begun to explore its geometry in |45j . 

Here we further investigate the extent and implications of this analogy, 
and of the geometric approach in general. We begin by making, in the next 
Section, a few observations regarding the extent of our results, by finding 
the largest space of signals wherein our results may be applied effectively. 
Next, in Section 3, we establish the proper analogies considering concepts 
originating from classical sampling and from coding theory, considered in 
the context of Gaussian channels. In doing so, we attempt to construct a 
"dictionary" of geometric sampling and concepts originating from Shannon's 
fundamental approach [33]. 

As already mentioned, the paper concludes with an Appendix containing, 
for the sake of completeness and as a convenient reference, a brief review of 
the proof of Theorem 1.1. 

1.2. General geometric signals. First, let us establish the following def- 
inition: 

Definition 1.3. A geometric signal is the graph Graph(/) of a function 
/ : R. m — > M. n , appertaining to a desired class (e.g. L 2 ,C 2 ,C°°), endowed 
with a (natural) geometric structure. 

The geometric structure, usually considered in vision and image process- 
ing, is the that of a Riemannian manifold. This is also the approach we 
followed in proving Theorem 1.1, as emphasized in the previous section. 
However, the much larger class of Alexandrov spaces (see, e.g. [3]) can be 
considered in applications (see [2]). 

Example 1.4. A basic example of a geometric signal is that of gray scale 
images, i.e. surfaces S in R 3 , S = ((x,y),h((x,y))), where (x,y) repre- 
sent the pixel coordinates and the function h represents the gray scale level 
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(intensity). In this case, the usual geometric structure considered is the Rie- 
mannian one induced by the ambient 3-dimensional Eclidean space, at least 
when S is considered to be a smooth surface. However, if a Combinatorial 
(discrete) Image Processing viewpoint is adopted, then one can consider S 
to be endowed only with its metric structure (inherited, again, from K 3 ), 
see for instance, (39], [40] . 



As a followup of the definition and example above, unless stated other- 
wise, we consider signals as graphs of functions endowed with their natural 
geometric structure. 

We begin our investigation by noting that, by the Paley- Wiener Theorem 
(see, e.g., [36]). any bandlimited signal is of class C°°. We have already shown 
in |41] that our geometric sampling method applies not only to bandlimited 
signals, but also to more general L 2 functions whose graphs are smooth C 2 
curves, not necessarily planar. In fact, the geometric sampling approach can 
be extended to a far larger class of manifolds. Indeed, every piecewise linear 
(PL) manifold of dimension n < 4 admits a (unique, for n < 3) smoothing 
(see for example [48]), and every topological manifold of dimension n < 3 
admits a PL structure (cf., for example, |48j). In particular, for curves and 
surfaces, one can first consider a smoothing of class > C 2 (so that curvature 
can be defined properly), which can then be sampled with sampling rate 
defined by the maximal curvature radius. Since a given manifold and its 
smoothing are arbitrarily close as smooth submanifolds of some R n (i.e. in 
the fine C 1 topology - see [31]), one obtains the desired sampling result. 
(This very scheme is developed and applied in [31] for gray-scale images.) 

While numerical schemes for practical implementation of smoothing exist, 
they are not necessarily computationally satisfactory. For practical appli- 
cations, one can circumvent this problem by applying numerical schemes 
based on the finite element method. However, for the sake of mathematical 
correctness and in order to be able to tackle more general applications, one 
should consider more general curvature measures (see, e.g. [52]) and avoid 
smoothing altogether (see Section 2 below, for a brief discussion of this topic 
in a slightly different context). 

It is worthwhile to highlight yet another aspect of our geometric sam- 
pling method: Shannon's Sampling theorem relates to bandlimited signals, 
that are, necessarily, unbounded in time or in spatial domain. Obviously, 
unbounded signals are not encountered in Signal/Image Processing, nor in 
any other practical implementations. However, geometric sampling does 
not necessitate having unbounded signals, quite the opposite: it is by far 
much easier to apply geometric sampling in cases of bounded manifolds. 
In practical implementations, this drastically reduces aliasing effects, while 
eliminating the need to produce periodic signals (surfaces). 
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2. Important Implications 

2.1. Pulse Code Modulation for Signals and Images. Our geometrical 
approach to sampling lends itself to consideration of a broader range of topics 
in communications. In particular, it offers a new method for PCM (pulse 
code modulation) of images considered as high dimensional objects and not 
as a 1-dimensional signal obtained by some projection map (scan), of the 
image to a single dimension. The geometric approach is endowed with an 
inherent advantage in that the sampling points are associated with relevant 
geometric features (via curvature) and are not imposed arbitrarily at equal 
intervals determined by the Nyquist rate. To be more precise, each code 
word is represented, according to the proposed geometric approach, by a 
(sampling) point in some TZ N , belonging to the given geometric signal. The 
reconstruction of the signal is, basically, the piecewise flat one described in 
the Appendix. Of course, better results can be obtained if smoothing of 
the manifold is considered, especially if this is done using a curvature-based 
kernel [2]. Since this process of smoothing requires one to encode also the 
curvature of the reconstructed piecewise linear manifold, there should be 
developed a way to quantize curvature so that the number of extra bits 
added should be bounded. 

Moreover, it should be stressed again that the geometric approach, based 
on curvature radii, inherently produces a sparse, with respect to the Nyquist 
rate, adaptive sampling (see [1]), lending itself to interesting benefits, insofar 
as various applications are concerned. Indeed, the sampling density is lower 
in (almost) flat regions. Therefore, fewer sampling points are needed for such 
regions. (See [1] for more details.) A version of Landau's Theorem [23], |25j 
about non-uniform sampling is also attained and will be referred to again 
in Section 3. Moreover, given that the theoretical tubular radius (defined in 
Section 3), which is in general practically impossible to compute, is replaced 
by the curvature radii, and since for certain types of manifolds better global 
estimates may be obtained in terms of other curvature measures (e.g the 
Ricci curvature (see PQ), one can in some special cases, lower rates than the 
principal curvature rate given in Theorem 11.11 



2.2. Vector Quantization for Images. A complementary byproduct of 
the constructive proof of Theorem 11.11 is a precise method of vector quan- 
tization or block coding. Indeed, the proof of Theorem 11.11 consists of con- 
struction of a Voronoi (Dirichlet) cell complex {7^}, whose vertices provide 
the sampling points. The set of centers {a^} of the cells, satisfying a certain 
geometric density condition, represent, as usual, the decision vectors. An 
advantage of this approach, besides its simplicity, is the possibility to esti- 
mate the error in terms of length and angle distortion, when reverting from 
the cell complex {77?} to the Euclidean cell complex {cjj} having the same 
set of vertices {7^} (see [34]). 
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2.2.1. Error bounds. Since the geometric method represented herein enables 
one to perfect reconstruction of the sampled manifold by an iterative process 
in which, at each iteration, a piecewise linear approximation is obtained it 
is important to have error bounds on the approximation at each iteration. 
It is shown in |41] (see appendix Theorem 14.12ft that this error in the can 
be bounded in terms of the fatness coefficient of the obtained triangulation 
(defined in the appendix, Definition 14. 4p and of the diameter of simplices. 

Yet, for a more accurate error assessment, it is desirable to have bounds on 
the local distortion of the metric between the piecewise-flat approximation 
and the intrinsic metric of the manifold. Bounding this distortion of metrics 
bounds the distortion of geometries of the two objects (the approximation 
and the manifolds) say, in terms of curvature measures, volume diameter and 
other geometric attributes. This will allow us to say that the reconstructed 
approximation not only approximate the manifold pointwise, but also gives 
a good approximation to the geometry of the samples manifold. This is 
given by the following Theorem, [34] 

Theorem 2.1 (|34j). If M = M n is a manifold without boundary, then 
locally, for any triangulation patch, the following inequality holds, 

3 5 

(2.1) jd M (x, y) < d eud (x, y) < -d M (x, y) ; 

where d euc i,dM denote the Euclidean and intrinsic metric (on M) respec- 
tively, and where x,y 6 M and x, y are their preimages on the piecewise-flat 
complex. 

(The building of these patches is essential for the control of the fatness of 
the triangulation. Their size essentially depends upon the (local) maximal 
curvature - see [M] and the Appendix.) 

For manifolds with boundary we have, 

Theorem 2.2 ([37]). 

3 5 

(2.2) -d M (x, y) - f{0)r} d < d eud (x, y) < -d M (x, y) + f(9)vdM ; 

where f(0) is a constant depending on the 9 = min {9qm, #intM} ~ the fatness 
of the triangulation of dM and int M, respectively, and r/g denotes the mesh 
of the triangulation (i.e. the supremum of the diameters of the simplices 
belonging to the triangulation) of a certain neighbourhood of dM (see [37] ). 

In other words, the (local) projection mapping, ir, between the trian- 
gulated manifold M and its piecewise-flat approximation £ is (locally) bi- 
lipschitz if M is open, but only a quasi-isometry (or coarsely bi-lipschitz) if 
the boundary of M is not empty. (In fact, as the two inequalities above 
show, the projection mapping tt satisfies, in both cases, slightly stronger 
conditions.) Note that inequalities (2.1.) and (2.2) imply that, both for 
open and bordered manifolds, control of the Euclidean error of the sampled 
points is equivalent to the control of the error for the sampled geometric 
signal. 
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2.3. Zador's Theorem. Yet, a more important benefit of the proposed 
approach stems from Zador's Theorem [51] • The latter basically states that 
it is more efficient to use high-dimensional quantizers [8] . This result implies 
that we can turn into an advantage the inherent curse of dimensionality. 
Indeed, by Zador's Theorem, the average mean- squared- error per dimension 
is: 



(2.3) £ = — d eud (x,p)p(x)dx , 

^ Jr n 

Pi being the code-point closest to x, and p(x) denotes the pdf of x, can be 
obtained more efficiently by means of higher dimensional quantizers (see 

0). 

Since for embedded manifolds, it obviously holds that p(x) = Pi(x)xm, 
where xm is the characteristic function of M, defined on the ambient space 
M. N , we obtain: 



(2.4) £ = — d eud (x,p i )p 1 (x)dx . 

It follows that if the main issue is accuracy, and not simplicity, then 1- 
dimensional coding algorithms perform far worse than higher dimensional 
ones. Of course, there exists an upper limit for the coding dimension. Oth- 
erwise, one could just encode the whole data as one iV-dimensional vector 
for N large enough, which in practice may be huge. The geometric coding 
method proposed here provides a natural high dimension for the quantiza- 
tion of M n which is, the embedding dimension N. Moreover, it closes (at 
least for images and any other data that can be represented as a Riemannian 
manifold) the open problem (related to Zador's Theorem) of finding a con- 
structive method to determine the dimension of a quantizer (Zador's proof 
is nonconstructive) . In fact, for a uniformly distributed input (such as a 
manifold, and for example, as a noiseless image assumed to be), a better 
estimate of the average mean-squared-error per dimension can be obtained: 



,„ c N Im u deucl{ x iPi)dx jy Jj^n d euc \{x , Pi)dx 

[ '' ~ f M ndx ~ V n {M™)dx ' 

where V n denotes the n-dimensional volume (area) of M. Whence, for com- 
pact manifolds, one obtains the following expression for £: 

in c\ c N Im™ deuci{ x i Pi)dx fj^ n d euc i(x,pi)dx 

where {Vi} represent the Voronoi cells of the partition. Moreover, we have 
the following estimate for the quantizer: Choose centers of cells such that 
the quantity 
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(2.7) Q 



1 m d euc i{x , pi)dx 



N 



Si Hi) 



is minimized. 

The embedding dimension N increases dramatically, even for compact 
manifolds and even taking into consideration Gromov's and Giinther's im- 
provements of Nash's original method (see [15], resp. [E]). For instance, 
n = 2 requires embedding dimension N = 10 and n = 3 the necessitates 
N = 14. Hence, for large enough n one can write following rough estimate: 



3. Sampling and Codes 



3.1. Packings, Coverings and Lattice codes. According to classical sig- 
nal processing theory, the required signal bandwidth W and the Nyquist 
sampling rate are constrained by the condition W = ry/2, where W and rj 
are the bandwidth and sampling rate respectively. This lends itself to an im- 
mediate generalization to periodic signals, or, in geometric terms, for signals 
represented over a lattice: A = {Aj}. One can even interpret the boundaries 
of the lattice as the coordinates in a multi-dimensional (warped) space or 
time (see, e.g. [37], [29]). (Alternatively, one can interpret the dimensions 
as representing wave-length, or even as combined fundamental quantities, 
e.g. space-time or even space-time-wave-length, as they arise in Medical 
Imaging (CT).) Note that such signals can be viewed as distributions on 
the n-dimensional torus T n = K n /Z n . According to this interpretation, the 
(n-dimensional!) period is the fundamental cell A of the lattice. Two scalars 
are naturally associated with this cell: its diameter, diam(A) (or, alterna- 
tively, the length of the longest edge), and its volume Vol(A). Either one 
may be used as a measure of the n-dimensional period. However, they are 
both interrelated and associated with one geometric feature, the so-called 
11 fatness''' : 

Definition 3.1. Let 7 = "y k be a /c-dimensional cell. The fatness (or aspect- 
ratio) of 7 is defined as: 

,0^ ( \ ■ V0l ( A ) 

(3.1) (p(pj) = mm 



A diam'(A) ' 

where the minimum is taken over all the /-dimensional faces of 7, < k. (If 
dim A = 0, then Vol(A) = 1, by convention.) 

In the case of simplices (and, since any cell can be canonically decomposed 
into simplices, of regular cells) this definition of fatness is equivalent to the 
following one (see [34]): 
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Definition 3.2. A /c-dimensional cell 7 is called ip-fat if there exists (p > 
such that the ratio > (p; where r denotes the radius of the inscribed sphere 
of 7 (or in-radius) and R denotes the radius of the circumscribed sphere of 
7 (or circum-radius) . A cell-complex T = is fat if there exists ip > 

such that all its cells are ip-fat. 

Recall that the in- and circum-radius are important in lattice problems: 
given a lattice A with (dual) Voronoi cell II (of volume 1), one has to 
minimize the in-radius, to solve the packing problem, and to minimize the 
circum-radius for solving the covering problem (see [8]). Note that A and II 
are simultaneously fat. It follows that fat cell-complexes and, in particular, 
fat triangulations, represent a mini-max optimization for both the packing 
and the covering problem. Moreover, since fat triangulations are essential for 
the sampling theorem for manifolds, it appears that there exists an intrinsic 
relation between the sampling problem for manifolds and the covering and 
packing problems. 

3.2. Average Power, Rate of Code and Channel Capacity. It is nat- 
ural to extend the classical definitions of average power of a signal: 



(3.2) 

and the rate of a code: 



1 
T 



T 



f(t)dt. 



(3.3) i?=ilog 2 AT, 

in the context of lattices with fundamental cell A, where N represents the 
number of code points, in the following manner: 

and 



respectively, iVi being the number of cells. 

Similarly, one can adapt the classical definition of the channel capacity: 



(3.6) C= lim R = lim 

to become 

(3-7) C = lim 1°^^ = lim - log 2 N. 

V ' T^ooVol(A) T~>oo AiVol(A) 82 
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Since ./V and N\ are related by Ni = a(N), where a is the growth function 
of the manifold, the expression of channel capacity, C, becomes: 



v ' T^ooVol(A) a(N) 

It follows that C = oo for non-compact Euclidean and Hyperbolic man- 
ifolds, and C = for their Elliptic counterparts. Unfortunately, no such 
immediate estimates can be easily produced for manifolds of variable curva- 
ture. 

Note that by substituting 1/T = Vol(M), the above definitions apply to 
any sampling scheme of any manifold of finite volume, not just to lattices. In 
this case N and N\ represent the number of vertices, respective simplices, of 
the triangulation. In the context of classical signal processing, this approach 
is known as "recurrent nonuniform sampling" (See also |5Uj.) 

The interpretation of frequency considered above does not extend, how- 
ever, to general geometric signals. For a proper generalization we have to 
look into the geometric analogue of W. Based on [42], according to Theorem 
5.2, for the case of curves, i.e 1-dimensional (geometric) signals, W equals 
the curvature rate k/2, were k represents the maximal absolute curvature 
of the curve. This, and the sampling Theorem 4.11 of [42], naturally lend 
themselves to the following definition of W for general geometric signals: 

Definition 3.3. Let M = M n be an n-dimensional manifold n > 2. W = 
Wm = 1/^M; where ku = maxfcj and ki,i = l,...,n are the principal 
curvatures of M. 

According to classical considerations, the energy E of the signal / : M. — > R 
is considered to be equal to its I? norm: 



k=— oo 

One would like, of course, to find proper generalizations of the notion of 
energy for more general (geometric) signals. In view of the above discussion, 
the first step is to replace 2W by the proper generalized expression. However, 
when considering more general function spaces of specific relevance (s.a. 
bounded variation (BV), bounded oscillation (BO), bounded mean oscillation 
(BMO)), one should consider energies fitting the specific norm of the space 
under consideration. This discussion is, of course, also valid with regard to 
the average power P, and rate R, of a geometric signal. 

We proceed to consider the first definition of code efficiency: the nominal 
coding gain (ncg) of a code c\ over another code, say (02), is defined as: 



(3.10) 



ncg(Cl,C2) = 10 log 



10 



E 2 
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where \x is the square of the minimal squared-distance between coding points. 
For geometric codes of bounded curvature (hence compact codes), the ex- 
pression for \x is in particular simple: [1 = 1/ min k (k denoting again prin- 
cipal curvature). 

3.3. The Channel Coding Problem. It is most natural to approach 
problems associated with the Gaussian white noise channel in the context 
of "geometric signals", i.e. in the context of manifolds. Recall that in the 
classical context, a received signal is represented by a vector X = F + Y, 
where F = (fi, . . . , /jv) is the transmitted signal, and Y = (yi, . . . , y n ) rep- 
resents the noise, whose components yi are independent Gaussian random 
variables, of mean and average power a 2 . The main, classical result for 
the Gaussian channel is the following: 

Theorem 3.4 (Shannon's Second Theorem, [44]). For any rate R not ex- 
ceeding the channel capacity Cq, 



there exists a sufficiently large T, such that there exists a code of rate R 
and average power < P, and such that the probability of a decoding error 
is arbitrarily small. Conversely, it is not possible to obtain arbitrarily small 
errors for rates R> Cq. 

In the case of geometric signals, F is given by the sampling (code) points 
on the manifolds and, since the mean equals 0, the noisy transmitted signal 
F + Y lies in the tube Tub CT (M). Recall that tubes are defined as follows: 

Definition 3.5. Let M C M m be an orientable embedded manifold, and let 
N p denote the unit normal to M at the point p. For each p £ M consider the 
open symmetric interval of length 1e p , I PjE , in the direction of N p , where 
e p is to be chosen small enough such that I p>£p n Ig i£q = 0, for all p,q £ 
M,\\p — oil 2 > £ € K+- Then Tub e (M) = UpeM-^p ^ s an °P en se t that 
contains M, such that for any point x G Tub e {M) there exists a unique 
normal line to M through x. Tub e {M) is called a tubular neigbourhood of 
M or just a tube. 

The existence of tubular neighborhoods is assured both locally, for any 
regular, orientable manifold, and globally for regular, compact, orientable 
manifold (see [H] ). In addition, the regularity of the manifolds <9Tub~(M) = 
M-\J P eM e ^P. 3Tub+(M) = M+\J peM eN p , where 9Tub"(M)U 5Tub+(M) = 
<9Tubo-(M), is at least as high as that of M: If M is convex, then <9Tub~(M), 
9Tub^T(M) are piecewise C 1 ' 1 manifolds (i.e. they admit parameterizations 
with continuous and bounded derivatives), for all a > 0. Also, if M is a 
smooth enough manifold with a boundary, that is, at least piecewise C 2 , then 
9Tub~(M), 3Tub^(M) are piecewise C 2 manifolds, for all small enough a 



(3.11) 




(see P2]). 
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In the geometric setting, a can be taken, of course, to be the maximal 
Euclidean deviation. However, a better deviation measure is, at least for 
compact manifolds, the Haussdorf Distance (between M and <9Tub~(M), 
dTub+(M)): 

Definition 3.6. Let (X, d) be a metric space and let A, B C (X, d). The 

Hausdorff distance between A and B is defined as: 

(3.12) d H (A, B) = max{sup d(a, B), sup d(b, A)} . 

For non-compact manifolds one has to consider the more general Gromov- 
Hausdorff distance (see, for example, [3]). 

Since, according to the above arguments, both the distance between M 
and <9Tub~(M), <9Tub+(M) and the deviations of their curvature measures 
are arbitrarily small for small enough cr, we can state a first qualitative 
geometric version of Shannon's Theorem for the Gaussian channel. While a 
perfect analogy is not available, we can nevertheless formulate the following 
theorem: 

Theorem 3.7. Let M n be a smooth geometric signal (manifold) and let a 
be small enough, such that Tub<j(M) is a submanifold o/K n+1 . Then, given 
any noisy signal M + Y, such that the average noise power ay is at most a, 
there exists a sampling scheme of M + Y with an arbitrarily small probability 
of resultant decoding error. 

The analogue of the capacity in the context of the geometric approach to 
codes is Cq = Co(n, a, r), where r represents the differentiability class of M. 

The existence of tube <9Tub+(M) is, as noted, guaranteed globally in the 
case of compact manifolds. Hence it follows that the sampling scheme is also 
global and necessitates O(N) points, N = Nm- However, for non-compact 
manifolds (in particular non-band limited geometric signals), the existence 
of (9Tubjr(M) is guaranteed only locally. Therefore "gluing "of patches is 
needed, an operation which requires the insertion of additional vertices (i.e. 
sampling points), their number being a function of the dimension of M. 
Hence, in this case, Nm+y = 0(N-fa). 

It is important to note that, again, this result is not restricted to smooth 
manifolds, but rather extends to much more general signals: Indeed, for any 
compact set Mei", the (n - l)-dimensional sets <9Tub~(M), <9Tub+(M), 
are Lipschitz manifolds{\.e. topological manifolds equipped with a maxi- 
mal atlas for which the changes of coordinates are Lipschitz functions), for 
almost any e (see [18] ). Moreover, the generalized curvatures measures of 
9Tub~(M), <9Tub^T(M) are arbitrarily close to the curvature of M, for small 
enough a ([7], [E]). It follows that the above generalization befits not only 
the case of the Gaussian noise, but to more general types of noise, as well 
(see, p], [19], [26]). 
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Also, we note en passant, that practically the same argument as above, 
with little (if any) modifications allows us to obtain a geometric version of 
Landau's result on the reconstruction of distorted signals, |30] . 

The full details of a quantitative version, including the general case, are 
however, more involved and warrant a more detailed consideration elsewhere. 

Before we conclude this section, we wish to emphasize that the impor- 
tance of tubes is not necessarily limited to Differential Geometry. It is just 
as important in Statistics (see, e.g. [28]). However, its relevance to sampling 
theory is in particular evident. Indeed, Shannon's ideas, as exposed in [43] 
and |44] are very similar to our approach (even if lacking the specific geomet- 
ric nomenclature). In particular, convergence of the measure of entropy of 
the noise introduced in [H] is easily obtained in the context of our approach 
and formalism. For instance, the equivalence of the tube radius is used in 
|43| as a measure of the uncertainty of the reconstruction (not to confused 
with the Heisenberg-related Uncertainty Principle). For the development of 
Shannon's approach see [46] , 

4. Appendix - A Concise Proof of Theorem 1.1 

The proof of Theorem 11.11 is essentially based on existence of fat triangu- 
lation for Riemannian manifolds. In the sequel we outline some definitions 
and notations, and review relevant results concerning the existence of such 
triangulations. 

Let M n denote an n-dimensional complete Riemannian manifold, and let 
it be isometrically embedded into M> N ("iV"-s existence is guaranteed by 
Nash's Theorem - see, e.g. |34|). 

Let W(x, r) = {y € W | d eud < r}; dM u (x, r) = ^(x, r). If x G M n , let 
a n (x,r) = M n nB"(i,r), (3 n (x,r) = exp x (M n (0, r)) , where: exp x denotes 
the exponential map: exp x : T x (M n ) M n and where B n (0,r) C T x (M n ), 
M n (0,r) = {y eR n \d eud (y,0) <r}. 

The following definitions generalize in a straightforward manner classical 
ones used for surfaces in M 3 : 

Definition 4.1. (1) S v_1 (x,r) is tangent to M n at x £ M n iff there 
exists S n {x,r) C S^^r), s.t. T x (S n (x, r)) = T x (M n ). 
(2) Let I C W be a line, then I is secant to X C M n iff 1 1 n X\ > 2. 

Definition 4.2. (1) S" _1 (x,p) is an osculatory sphere at x € M n iff: 

(a) S I/_1 (x,/3) is tangent at x; 
and 

(b) M n (x,p)nM n = 0. 

(2) Let X C M n . The number lo = lux = sup{p > | § I/ ~ 1 (x, p) osculatory 
at any x G X} is called the maximal osculatory (tubular) radius at 
X. 

Remark 4.3. There exists an osculatory sphere at any point of M n (see [1] ). 
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4.1. Fat triangulations. 



Definition 4.4. 



(1) A triangle in M 2 is called tp-fat iff all its angles are 



larger than a prescribed value <p > 0. 

(2) A k-simplex r C M n , 2 < fc < n, is v 9- /^ if there exists 99 > such 
that the ratio j% > <p, where r and R, are respectively, the radii of 
the inscribed and circumscribed (k-l)-spheres of r. 

(3) A triangulation T = {crjjjgi is fat if all its simplices are (p-fat for 
some 93 > 0. 

Proposition 4.5 Q6J). There exists a constant c{k) that depends solely upon 
the dimension k of t such that 



where (p denotes the fatness of the simplex t, Z(t, a) denotes the (Internal,) 
dihedral angle of the face a < r and Volj (a) ; diam a stand for the Euclidian 
j -volume and the diameter of a, respectively. (If dim a = 0, then Volj(a) = 
1, by convention.) 

Condition 14.11 is just the expression of fatness as a function of dihedral 
angles in all dimensions, while Condition 14.21 expresses fatness as given by 
"large area/diameter". Diameter is important since fatness is independent 
of scale. 

Existence of fat triangulations of Riemannian manifolds is guaranteed by 
the studies quoted below. 

4.1.1. Compact manifolds: In the seminal contribution of Cairns, [1], the 
following is proved, 

Theorem 4.6 ([!])• Every compact C 2 Riemannian manifold admits a fat 
triangulation. 

4.1.2. Open manifolds: 

Theorem 4.7 ([31]). Every open (unbounded) C°° Riemannian manifold 
admits a fat triangulation. 

4.1.3. Manifolds with boundary of low differentiability: 

Theorem 4.8 ([37]). Let M n be an n- dimensional C 1 Riemannian manifold 
with boundary, having a finite number of compact boundary components. 
Then, any fat triangulation of dM n can be extended to a fat triangulation 



(4.1) 




and 



(4.2) 




ofM n . 
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The method used to prove Theorem 14.1. H presented in |1] , is to produce 
a point set A C M n , that is maximal with respect to the following density 
condition: 



One makes use of the fact that for a compact manifold M n we have \A\ < 
Ho, in order to construct the finite cell complex "cut out of M" by the 
i/-dimensional Dirichlet complex, whose (closed) cells = cX are given by: 



For further details, see [1]. 

The proof of Theorem 14.71 [34] . is based on adapting Cairns' method to 
the non-compact case. Essential steps in the proof are as follows. 

(i) Start with some compact submanifold Mq of M n . 

(ii) Decompose M n as an exhaustion by open submanifolds, starting with 
Mq, namely present M n as, 

M n = (J Mj 1 ; Mj 1 C MjVi ; Mf~ \ M™ is compact . 

(hi) Construct a fat triangulation of the initial compact submanifold Mq 
according to @], and iteratively extend it from to M^ +l until a fat 
triangulation of the whole of M n is obtained. 

In order to prove Theorem 14.81 one first constructs two fat triangulations: 
71 of a product neighbourhood N of dM n in M n and T2 of intM n , the 
existence of which follows from Peltonen's result [M], and then "mashes" the 
two triangulations into a new triangulation T, while retaining their fatness. 
While the mashing procedure of the two triangulations is basically the one 
developed in the original proof of Munkres' theorem |31j . the triangulation 
of 7i has been modified, in order to ensure the fatness of the simplices of 
Ti- The method we have employed for fattening triangulations is the one 
developed in [6]. For the technical details, see [57] . 

4.2. From fat triangulations to sampling. We first restate Theorem ll.il 
Theorem ([41]): Let E be a connected, non-necessarily compact smooth 
surface (i.e. of class C k ,k > 2), with finitely many boundary components. 
Then, there exists a sampling scheme of S, with a proper density T> = 

V{p) = T>[t^\, where k(p) = max{|&i|, |Ai2|} ; and k\,k,2 are the princi- 
pal curvatures of S, at the point p € S. 



(4.3) 



d(ai, 02) > rj , for all ax, a% € A ; 



where 



(4.4) 
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Proof The sampling points are provided by the vertices of the fat triangu- 
lation constructed above. The fact that the density is a function solely of 
k = max{\ki\, \ k n \} follows from theorem 14. 1.1 1 [4]. and from the fact that 
the osculatory radius u 7 (p) at a point p of a curve 7 equals l/k 1 (p), where 
k^(p) is the curvature of 7 at p ; hence the maximal osculatory radius (of £) 
at p is: u(p) = max{|fci|, \k n \} = max{^, ^}. (Here Ui , i = 1, n 
denote the minimal, respective maximal sectional osculatory radii at p.) 

□ 

Since for unbounded surfaces it may well be that k — > 00, it follows that 
an infinite density of the sampling is possible. However, for practical imple- 
mentations, where such cases are excluded, we have the following corollary: 

We also quote here the following immediate corollary derived from The- 
orem [Ll] 

Corollary 4.9 ([41]). LetT,,T> be as above. Assume that there exists fco > 0, 
such that ko > k(p), for allp € S. Then, there exists a sampling o/E having 
uniformly bounded density. 

In the following cases there exist ko as in the above Corollary 14.91 ([41J): 

(1) S is compact. 

(2) There exist H 1 ,H 2 ,K 1 ,K 2 , such that H\ < H(p) < H 2 and K x < 
K(p) < K 2 , for any where H, K denote the mean, respective 
Gauss curvature. (That is both mean and Gauss curvatures are 
pinched.) 

(3) The Willmore integrand W(p) = H 2 (p) — K(p) and K (or H) are 
pinched. 

Theorem II .11 is valid for non-smooth surfaces, (|41j). 
4.3. Reconstruction. 

Definition 4.10 f[3"I]). (1) Let / : K -> W 1 be a C r map, and let 
5 : K — > W + be a continuous function. Then g : \K | — > W 1 is called 
a 5 -approximation to f iff: 

(i) There exists a subdivision K' of K such that g 6 C r (K' ,M. n ) ; 

(ii) d eud (f(x),g(x)) < 8(x) , for any x € \K\ ; 

(hi) d euc i(df a (x),dg a (x)) < 5(a) -d euc i(x,a) , for any a € and for 
all xeSi(a,K'). 

(2) Let i^' be a subdivision of iT, U = U, and let / € C r (K,M n ), 5 G 
C r (K',M. n ). g is called a 5 -approximation of / (on [/) iff conditions 
(ii) and (hi) above hold for any a € U. 

Definition 4.11 ([3"T]). Let / G C r (K) and let s be a simplex, s < a £ K. 
Then the linear map: L s : s — > M n , defined by L s (v) = f(v) where v is a 
vertex of s, is called the secant map induced by f. 

The motivation for having fat triangulations for manifolds in terms of 
reconstruction of sampled manifolds is stressed by the following theorem. 
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Theorem 4.12 ([3T]). Let f : a -)■ R n 6e 0/ dass C fc . TTien, /or 5 > 0, i/iere 
exists e, fo > 0, such that, for any t < a, fulfilling the following conditions: 

(i) diam(r) < e and, 

(ii) t is (fo-fat, 

then, the secant map L T is a 5 -approximation of f\r. 

Following Theorem 14.121 we use the secant map as defined in Definition 
14.111 m order to reproduce a PL-manifold as a ^-approximation for the 
sampled manifold. We may now use smoothing in order to obtain a C°° 
approximation. 

It should be emphasizes here that Theorem 11.11 produces an infinite se- 
quence of PL-approximations of the sampled manifold which, as already 
stated above, converge, when the diameter of simplices tends to zero, to the 
original sampled manifolds. Moreover, following [6], we also have that the 
discrete curvature measures given on the approximating manifolds converge, 
as measures, to the sectional curvature of the sampled manifold. This is in 
accordance with the fact that, in order to achieve proper reproducing of a 
1-dimensional signal according to Shannon Theorem, as in [33], one has to 
account for an infinite summation. 
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